Gestural Control of Music Using the Vicon 8 Motion Capture System
نویسندگان
چکیده
This article reports on a project that uses unfettered gestural motion for expressive musical purposes. The project involves the development of, and experimentation with, software to receive data from a Vicon motion capture system, and to translate and map that data into data for the control of music and other media such as lighting. In addition to the commercially standard MIDI—which allows direct control of external synthesizers, processors, and other devices—other mappings are used for direct software control of digital audio and video. This report describes the design and implementation of the software, discusses specific experiments performed with it, and evaluates its application in terms of aesthetic pros and cons. Category and Subject Descriptor Design report on new interface for musical expression: Realtime gestural control in music.
منابع مشابه
Mapping sound to human gesture: demos from video-based motion capture systems
We report research on gestural control of digital music, currently performed at the University of California Irvine. Experiments with various motion capture systems are performed, including single video camera systems and a 3D optical motion capture system (Vicon 8). We present a series of demos of various approaches for motion analysis and gesture-to-sound mapping.
متن کاملMusic control from 3D motion capture of dance
Research is currently being conducted at the University of California Irvine to develop novel approaches in music performance and composition generated from dancer’s gestures. We report here specifically the modification of the “Vicon 8” motion capture system to control digital music. This system allows for the capture of a dancer’s movement in 3D. Software is being developed, in the “Max/MSP” ...
متن کاملPlaying the "MO" - Gestural Control and Re-Embodiment of Recorded Sound and Music
We are presenting a set of applications that have been realized with the MO modular wireless motion capture device and a set of software components integrated into Max/MSP. These applications, created in the context of artistic projects, music pedagogy, and research, allow for the gestural reembodiment of recorded sound and music. They demonstrate a large variety of different ”playing technique...
متن کاملA Framework for Sonification of Vicon Motion Capture Data
This paper describes experiments on sonifying data obtained using the VICON motion capture system. The main goal is to build the necessary infrastructure in order to be able to map motion parameters of the human body to sound. For sonification the following three software frameworks were used: Marsyas, traditionally used for music information retrieval with audio analysis and synthesis, CHUCK, ...
متن کامل3D motion capture data: motion analysis and mapping to music
We report research performed on gesture analysis and mapping to music. Various movements were recorded using 3D optical motion capture. Using this system, we produced animations from movements/dance, and generate in parallel the soundtrack from the dancer's movements. Prior to the actual sound mapping process, we performed various motion analyses. We present here two methods, both independent o...
متن کامل